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We derive the microcanonical ensemble from the Maximum Entropy Principle (MEP) using the 
phase space volume entropy of P. Hertz. Maximizing this entropy with respect to the probability 
distribution with the constraints of normalization and average energy, we obtain the condition of 
constant energy. This approach is complementary to the traditional derivation of the microcanonical 
ensemble from the MEP using Shannon entropy and assuming a priori that the energy is constant 
which results in equal probabilities. 
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I. INTRODUCTION 



The seminal works of Jaynes [jj, |2| presents the information theory approach to statistical physics using the Maximum 
Entropy Principle (MEP). In the original papers, Jaynes maximized the Shannon information entropy using constraints 
of normalization and average energy to obtain the canonical ensemble. Later on, Tsallis [|| maximized generalized 
information entropies, like the Rcnyi and Tsallis entropies, using constraints of normalization and average energy to 
obtain deformed exponential distributions that describe the behavior of nonextensive systems. 

In this paper we show that there is also a special information entropy associated with the microcanonical ensemble. 
This microcanonical information entropy is the phase-space volume entropy, originally due to P. Hertz Q (see also ||) 
that satisfies the heat theorem jf| 0, Using this entropy in the MEP with constraints of normalization and average 
energy, we obtain the condition that the energy distribution is a delta function, i.e., we derive the microcanonical 
ensemble from the MEP. 

In Section 2 we review the traditional application of the MEP to the microcanonical ensemble. The quantum 
statistical application of the MEP with discrete probabilities using the volume entropy is treated in Section 3. The 
classical statistical application is given in Section 4, which employs integration and functional differentiation with 
continuous probability distribution functions. The conclusion is given in Section 5. 



II. TRADITIONAL APPROACH TO THE MICROCANONICAL ENSEMBLE 



The traditional MEP is reviewed here to contrast it with our approach and to establish the notation. The traditional 
approach to the quantum microcanonical ensemble starts with the assumption that the system is isolated and has a 
fixed energy U. Such a macrostate of energy U can be realized in a number W of possible ways each corresponding 
to a microstatc i. Then one looks for the probability pi that the system is in a certain state i with energy U. In 
quantum mechanics U is an eigenvalue of the Hamiltonian operator Ep and W is its degeneracy gp, i.e., U = Ep and 
W = gp. Since we are looking for the probability of a state i that is already assumed to belong to the eigenvalue Ep, 
the traditional MEP does not have to use the energy constraint and is 



Pj l °SP] ~ X \ p -> ' ~ 1 = maximum , (1) 
where the first term is Shannon entropy and the sums are over states restricted to j G {j \Ej = Ep} . 
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The MEP in {l} gives Laplace's Principle of Insufficient Reason 

Pi = — = constant for i £ {j \Ej = Ep} , (2) 

9/3 

that shows the states j in the given macrostate j3 with energy Ep are equiprobable. Thus the maximization procedure 
gives us a flat distribution. With some abuse of terminology Eq. ^ is often referred to as the "microcanonical 
ensemble," but it is defined only for the states j such that Ej = Ep. Strictly speaking, the microcanonical ensemble 
is defined on the whole phase space and constrains the system state to lie on a given surface of constant energy. The 
microcanonical ensemble of energy Ep is really given as [9( 

Pi = —S Kr (Ei,Ep) (3) 

9/3 

where 5kt is the Kronecker delta [Skt(x, y) = 1 for x = y and for x y]. The Kronecker delta does not appear in 
Eq. @ because it is assumed a priori. 

We stress that the traditional approach does not maximize on the whole set of eigenstatcs of the Hamiltonian but 
rather on the subset of eigenstatcs belonging to the eigenvalue Ep. This approach is quite different from Jaynes's 
derivation of the canonical ensemble, where i runs over all the energy eigenstatcs. In the following section we ask the 
question: Is it possible to derive the microcanonical ensemble in (0) from a suitable MEP performed on the whole set 
of eigenstates, as Jaynes did for the canonical ensemble ? 



III. DERIVATION OF THE MICROCANONICAL DISTRIBUTION: QUANTUM CASE 

In order to answer to the question posed above, let us proceed by analogy with Jaynes's approach to the canonical 
ensemble. In order to obtain the canonical distribution, 

Pi = Z-'e~^. (4) 

where Z is the partition function, and is the absolute temperature, one maximizes the Shannon entropy 
— pi logft under the energy constraint U = ^ZiPiEi and the normalization constraint ~Y^iPi = L where i runs 
over all energy eigenstates. When the Shannon entropy is evaluated with the maximal distribution ([4J we obtain the 
correct thermodynamic entropy 

/3C/ + log^e-^". (5) 

71 

This thermodynamic entropy is correct in the sense that it satisfies the heat theorem whenever the averages are 
calculated over the canonical ensemble [Io| . 

In the microcanonical case the correct thermodynamic entropy that satisfies the heat theorem is given by the 
logarithm of the volume of phase space enclosed by the hypersurface of energy U = Ep 0, I n the quantum 
version such entropy is 

S(U) = log^(U) = logJ20(U-E j ), (6) 

3 

where 9(x) is the step function [9(x) = 1 for x > 0, and for x < 0]. 

Since we are now performing the maximization on the totality of eigenstates, we must use the energy constraint 
as we do with the canonical ensemble. Thus we are maximizing © under the normalization and average energy 
conditions, 

X> = 1 > z2pi E i= U > ( ? ) 

3 3 

Using the constraints in Eq. 0, we can rewrite the entropy in Eq. © as 

Sip) = \ogJ2d fepkEk - E j J2pl) (8) 
j \ k k J 
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where the sums on j and k are over all states. The discrete probability distribution p = {pi} for the microcanonical 
ensemble is obtained when this entropy is an extremum. Differentiating Eq. ([5]) with respect to Pi and setting the 
result equal to zero, we obtain 

Wrm EHU-E j) (E i -E j) = 0, (9) 

for each state i, where 0'(x) = S(x) is the Dirac delta function. We can see by inspection that Eq. @ is satisfied if 
Ej ^ U. When Ej = U the state i must be such that Ei = Ej [because x5(x) =0]. In the latter case we have Ei = U. 
The probability distribution for states i is therefore 

Pi = A i S Kr (E i ,U = Ep), (10) 

where A t are yet to be determined. The Kronccker delta 5x r (E,i, Ep) imposes the restriction that the probability of 
states i ^ {i\Ei = Ep} are zero. 

Since there is nothing to distinguish different states i £ {i\Ei = Ep}, we can invoke Laplace's Principle of Insufficient 
Reason, obtained from the traditional MEP approach, to choose Ai = Ap to be the same for all states belonging to 
the same eigenenergy Ep. Using the constraint of normalization in Eq. ([7]), we obtain 

Pi = —S Kr (Ei,Ep), (11) 
90 

which is the microcanonical probability distribution. The only nonzero contributions are from states i with fixed 
energy E z = Ep. 



IV. DERIVATION OF THE MICROCANONICAL DISTRIBUTION: CLASSICAL CASE 

The derivation of the classical microcanonical distribution proceeds in a way analogous to the quantum derivation. 
Because we need to use a continuous probability distribution, we must use integration and functional differentiation 
in the MEP. However, the treatment is sufficiently different to merit some discussion. 

Equation ([9]) for the classical volume entropy of P. Hertz [J] is 

S(U)= log <&([/), (12) 

where U is again the energy. In the classical case the function <&([/) is now the volume of phase space enclosed by the 
hypersurface of energy U [7| 



<S>{U) = dz = / dz 6{U - H(z)), (13) 

where the Hamiltonian is H(z) and the step function 9(U — H(z)) provides the limits for the integral. The phase 
space coordinate z = (q, p) consists of the set of canonical coordinates q = in n-dimensional space and the set 

of their conjugate canonical momenta p = {p;}™ =1 . The element of volume in 2n-dimcnsional phase space is dz =d n q 
d n p and integration is over all phase space if no limits are shown. 

For the classical case, the constraints on normalization and average energy corresponding to Eq. (J7]) are 

J dzp{z) = 1, J dzp{z)H(z) = U, (14) 

respectively, where p(z) is the probability density in phase space. The MEP for the classical microcanonical ensemble 
is analogous to the quantum case. Using Eq. (|13|) and the constraints of normalization and average energy in Eq. 
(|14[). we can rewrite the entropy in Eq. (fl~2|) as a functional 



= lo g y dz' 6 (^J dz"p{z")H{z")-H{z') J dz" f 



where the integration is over all phase space. The continuous probability distribution p = p(z) for the microcanonical 
ensemble is obtained when this entropy is an extremum. Functionally differentiating Eq. (fl"5|) with respect to p(z) 
and setting the result equal to zero, we obtain 



8S[p] 1 



5p{z) $([/) 



j dz'S (U - H(z')) (H(z) - H(z')) = 0. (16) 
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By inspection we see that this equation is satisfied if z' is such that H(z') ^ U. When H(z') = U for some values z'we 
must also have H{z') = H (z) for some values of z [because x5{x) = 0]. In the latter case we therefore have H(z) = U. 
The distribution function p(z) therefore has a delta function that restricts the Hamiltonian to the hypcrsurface of 
energy U , 

p(z)=A(z)6(U-H(z)), (17) 

where A(z) is an arbitrary function of z, Since there is nothing to distinguish different points in phase space z 6 
{z|_ff(z) = U} that are all on the energy hypcrsurface, we can invoke Laplace's Principle of Insufficient Reason to 
choose A(z) = Ajj, which is constant for fixed U for all these phase space points. The normalization condition in Eq. 
(PHI) then becomes 



J dzp{z) = J dz A(z) 5{U- H{z)) = A v J dz 8 {U - H{z)) = 1. (18) 

The last integral in Eq. (|18[) can be performed by making a change of variables to e = -ff (z), which gives 

J dz6(U-H(z)) = J de^5{U-e) = =n{U), (19) 

where the function Sl(U) is the density of states for energy U, i.e., the number of states per unit energy. Substituting 
Eq. (fT^|) into Eq. lfT8"|) , we obtain Ajj = 0(C7) — 1 . Therefore, the probability distribution function in phase space in 
Eq. (fTT|) becomes 

p(z) = -^6(U-H(z)), (20) 

which is in fact the well-known classical microcanonical distribution. If the phase space point z is not on the energy 
hypersurface U = H(z) the probability density is zero. This probability density is analogous to the probability 
distribution in Eq. (|11[) for the quantum case, where the degeneracy g@ corresponds to the density of states Q(U). 



V. CONCLUSION 



In this work we have reviewed the traditional information-theoretic approach to the microcanonical ensemble. In 
contrast to the derivation of the canonical ensemble, the maximization for the traditional approach to the micro- 
canonical ensemble is performed on a sub-manifold of the Hilbert space (phase space in the classical case) rather than 
on the whole Hilbert (phase) space. Thus the microcanonical ensemble is assumed in the traditional approach rather 
than derived. In our approach we have used the Hertz volume entropy with constraints of normalization and average 
energy to show that it leads to the correct microcanonical distribution. 

Some of the significant differences between the traditional approach to the MEP in Eq. (|TJ) and our approach to 
the MEP in Eqs. ([8]) and (fT5|) for the microcanonical ensemble are the following. 

1. The traditional MEP assumes that the microstate i belongs to energy eigenvalue Ep, whereas our MEP derives 
such condition. 

2. The traditional approach employs the Shannon entropy without an energy constraint, whereas we employ the 
Hertz volume entropy with the energy constraint. 

3. The traditional MEP derives Laplace's Principle of Insufficient Reason for the states belonging to the eigenencrgy 
Ep, whereas our MEP invokes Laplace's principle after deriving the condition that the state i must belong to 
Ep. 

In the latter case we see that our approach, rather than being in contrast with the traditional one, completes it. 
First one maximizes the Hertz entropy to select the microcanonical energy level. At this point can use the traditional 
method to find that all states with that energy have the same probability. 
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